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ABSTRACT. 

A median (Ll-norm) filtering program using polynomials was 
developed. This program was used in automatic recycling 
data screening. Additionally a special adaptive program 
to work with asymmetric distributions was developed. 
Examples of adaptive median filtering of satellite laser 
range observations and TV satellite time measurements are 
given. The program proved out versatile and time saving 
in data screening of time series measurements. 


1 . INTRODUCTION 

The advantages of data screening of satellite laser range 
measurements using median (or Ll-norm) instead of least 
squares were shown earlier (Paunonen 1989) . The median is 
known to be insensitive to outlying observations, which is 
a useful property in preliminary data screening of any 
time series measurements. Asymmetric distributions often 
arise for various reasons; saturation of the laser detector 
and the receiver electronics, laser prepulses etc. This 
cannot be easily treated with least squares methods. 

In response to multiple needs, a median program permitting 
use of a higher order polynomial of up to ten was developed. 
A second version used automatic recycling of the fitting loop 
until a specified fit was obtained and a special program to 
work with unsymmetric distributions was devised. Examples 
of screening satellite laser range observations and TV 
satellite time measurements are given. 
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2.1 MEDIAN PROGRAM 


The median program was constructed with the Fortran- 
procedure published by Barrodale and Roberts (1974), 
modified for polynomial use. The function to be minimized 
in the overdetermined case is 
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where y-j are the observations, the observing times (here) , 
M the number of observations and N the degree of the 
polynomial to be fitted to the observations, and aj (j=O...N) 
the coefficients of the polynomial. 


2.2 AUTOMATIC MEDIAN FILTER PROGRAM 

A versatile data screening program should be able to run 
automatically, without any manual interface. The median is 
good basis for a filtering program, because it selects reliably 
the densest part of the measurements as a reference. This means 
that any erratic points, that is outliers, are of true size, and 
not evened out as in the least squares method. Operation of the 
sequential median filtering program is started by forming the 
residuals of all the observations and calculating their average. 
Observations below a certain rejection limit are selected 
for the next cycle only. The problem is to find a suitable 
limit which is neither too inclusive nor too exclusive. Good 
operation was obtained by using the rejection level, R, 

R = 3.5 * AVR , (2) 

where AVR is the average of the residuals in the earlier 
round. For a Gaussian-shaped distribution the width between 
the zero and the point corresponding to one standard 
deviation is 1.46 times the width corresponding to the 
average. Thus the limit used is roughly equivalent to 2.4 
times the standard deviation used in the least squares 
method. The repeated rounds are limited to four, but the 
final selection is generally ready after three rounds. 


2.3 ADAPTIVE AUTOMATIC MEDIAN FILTER PROGRAM 

In practice,, the distribution of the data may be asymmetric 
and may include separated peaks. In satellite laser ranging, 
a distribution as shown in Fig.l can easily arise with mode- 
locked lasers. The transmitted pulse may contain a small 
prepulse if selection of a single laser pulse from a train 
of mode-locked laser pulses is incomplete. Even if the 
parasitic pulse is small, it causes stops in the photon 
counting mode. This poses difficulties for normal 
screening methods using least squares. Use of only 
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Fig. 1. An asymmetric distribution of possible range 
residuals in satellite laser ranging. 


a two sigma-limit (Appleby and Sinclair 1991) is possible, 
but it may also fail if the contamination is severe. 

The median is expected to perform better because it finds 
the location of the main pulse more easily. The main part 
may also show unbalanced distribution (skewness) due, for 
instance, to saturation effects in the receiving 
electronics . 

A modified method for asymmetric distributions is proposed 
as a refinement of the median filter described. Because 
the median produces separate average values for positive 
and negative residuals, AVR+ and AVR-, respectively, the 
program is allowed to select a minimum of the absolute 
values, and use it as the basis for the rejection limit 
in Eg. (2) , ( 


AVR = Min ( | AVR+ | , | AVR- | ) . ( 3 ) 

At least mild skewness will be corrected in this way. 

If the distribution is symmetric, operation is normal. 


3. TESTS OF THE ADAPTIVE MEDIAN FILTERING 

The first test set was obtained from satellite laser 
range observations to the distant LAGEOS- satellite 
at Metsahovi, Fig. 2a. This is a mixture of good and bad 
observations. The points on the shorter range side arose 
from the shape of the laser pulse (Paunonen 1989). 

The short 4.5 ns pulse was cut by an electro-optical 
shutter from a 20 ns long ruby laser pulse. However, 
the shutter operation was not perfect and sometimes some 
leakage due, for instance, to changing temperature, may have 
occurred. This leakage, which was less than 10 per cent, looks 
like a pedestal on which a short pulse is riding. 


2-46 



RANGE RESIDUALS (m) RANGE RESIDUALS (m) 


METSAHOVI 1989-12-09 

LAGEOS 

RAW DATA 



J I I I L 

0 10 20 30 40 

T I ME (mi n ) FROM 4 h 33 m 00 S UT 


METSAHOVI 1989-12-09 
LAGEOS 

1 - (b) ADAPTIVE MEDIAN FILTERING 



-1 k 





• • 





1 I I I 1 1 

0 10 20 30 40 

TIME(min) FROM 4 h 33 m 00 s UT 

Fig. 2. a) Unscreened range residuals in a LAGEOS pass 

b) Range residuals after adaptive median filtering 
(linear fit). 
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The energy ahead of the main pulse may stop the time interval 
counter. The adaptive median filter selected 22 observations 
from the 33 available ones (Fig. 2b). The initial data set is 
not random, because similar results were also obtained at the 
calibration line. The result is also plausible, because its 
width corresponds to the laser pulse width. The earlier 
method for testing one observation at a time (Paunonen 1982) 
would be of little value, without knowing what to seek. 

Another test set originated from recent TV satellite time 
measurements (Fig. 3a) . Here the second tick from the station 
clock started the time interval counter and the horizontal 
syncronization pulse from a satellite TV receiving system 
(50 Hz rate) stopped it. The large number of badly timed 
pulses propably originated from the encrypting method 
the TV transmission (program RAIUNO on the EUTELSAT 1-F5 
satellite) is using. This set was also cleared well with the 
adaptive median filter (Fig. 3b). The r.m.s. value of the 
residuals was 11 ns. 


4. DISCUSSION AND CONCLUSIONS 

The adaptive median filter has proved to be versatile and 
to save time. It can safely remove several outliers, how- 
ever large they are. This is a big advantage over the least 
squares method, in which all large outliers must be removed 
before any useful operations can be obtained. Polynomials 
should be used with care also in median filtering. 

End points in particular may behave peculiarly. 

The median program sets the value of some residuals at zero 
(this number is same as the degree of the polynomial) , 
which is artificial. The asymptotic estimation efficiency 
of median is also usually worse than that of the 
mean (Eadie, et.al. , 1971) . It seems therefore best to use 
the median in the data screening phase and to use the normal 
least squares method for final extraction of the results. 

Use of the least squares is then well justified, because 
the distribution of the screened data is nearly normal. 
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